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Abstract 

In this paper we study the semi-global (approximate) state feedback stabiliza- 
tion of an infinite dimensional quantum stochastic system towards a target 
state. A discrete-time Markov chain on an infinite-dimensional Hilbert space 
is used to model the dynamics of a quantum optical cavity. We can choose an 
(unbounded) strict Lyapunov function that is minimized at each time-step in 
order to prove (weak-*) convergence of probability measures to a final state 
that is concentrated on the target state with (a pre-specified) probability 
that may be made arbitrarily close to 1. The feedback parameters and the 
Lyapunov function are chosen so that the stochastic flow that describes the 
Markov process may be shown to be tight (concentrated on a compact set 
with probability arbitrarily close to 1). We then use Prohorov's theorem and 
properties of the Lyapunov function to prove the desired convergence result. 

Keywords: Quantum control, Lyapunov stabilization, Stochastic stability, 
One-parameter semigroups 



1. Introduction 

In this paper we consider the stabilization of a discrete-time Markov pro- 
cess (Equations (3) and (4)) that is defined on the unit sphere on an infinite- 
dimensional Hilbert (Fock) space % at a target state which is a specific 
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unit vector in % corresponding to a photon-number state. We consider a 
Lyapunov function based state-feedback controller that drives our quantum 
system to the target state with probability greater than some pre-specified 
probability 1 — e for all 1 > e > 1 . 

The specific physical system under consideration uses Quantum Non- 
Demolition (QND) measurements to detect and/or produce highly nonclas- 
sical states of light in trapped super- conducting cavities [3, 4, 5] (see [6, 
Ch. 5] for a description of such quantum electro-dynamical systems and [7] 
for detailed physical models with QND measures of light using atoms). In 
this paper we examine the feedback stabilization of such experimental setups 
near a pre-specified target photon number state. Such photon number states, 
with a precisely defined number of photons, are highly non-classical and have 
potential applications in quantum information and computation. 

As the Hilbert space % is infinite dimensional it is difficult to design feed- 
back controllers to drive the system towards a target state (because closed 
and bounded subsets of % are not compact). In [1, 2] a controller was 
designed by approximating the underlying Hilbert space H with a finite- 
dimensional Galerkin approximation %N max - Physically this approximation 
leads to an artificial bound N max on the maximum number of photons that 
may be inside the cavity. In this paper we wish to design a controller for 
the full Hilbert space T-L without using the finite dimensional approxima- 
tion. Simulations (see [8]) indicate that the controller in Theorem 3.1 below 
performs better than the one designed using the finite-dimensional approxi- 
mation in [1, 2]. 

Controlling infinite dimensional quantum systems have previously been 
examined in the deterministic setting of partial differential equations, which 
do not involve quantum measurements. Various approaches have been used 
to overcome the non-compactness of closed and bounded sets. One approach 
consists of proving approximate convergence results which show convergence 
to a neighborhood of the target state for example in [9, 10]. Alternatively, 
one examines weak convergence for example, in [11]. Other approaches such 
as using strict Lyapunov functions or strong convergence under restrictions 
on possible trajectories to compact sets have also been used in the context 



lr The problem of output feedback control has been examined in the finite-dimensional 
context in [1. 2] using a quantum adaptation of the Kalman filter. We do not discuss the 
problem of estimating the state of the system and refer the reader to [1] for further details 
on designing a state estimator. 
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of infinite dimensional state-space for example in [12, 13]. 

The situation in our paper is different in the sense that the system under 
consideration is inherently stochastic due to quantum measurements. The 
system we consider may be described using a discrete time Markov process 
on the set of unit vectors in the state Hilbert space % as explained in Sub- 
section 2.3. We use a strict Lyapunov function that restricts the system 
trajectories with high probability to compact sets as explained in Section 3. 
We use the properties of weak-convergence of measures to show approximate 
convergence (i.e. with probability of convergence approaching one) of the 
discrete time Markov process towards the target state. 

1.1. Outline 

The remainder of the paper is organised as follows: in the following Sec- 
tion 2 we introduce some notation and the system model of the discrete- 
time Markov process. We also recall some results concerning the (weak-*)- 
convergence of probability measures. In Section 3 we state the main result 
of our paper (Theorem 3.1) concerning the approximate semi-global stabiliz- 
ability of the Markov process at our target state. We also provide a proof of 
the main result using several Lemmas. We then present our conclusions in 
the final Section. 

2. Definitions and System Description 

We introduce some notation that will be used to describe the discrete-time 
Markov process that characterizes the system. 

2.1. Notation 

In this paper, we use Dirac's Bra-ket notation commonly used in Physics 
literature 2 . The system Hilbert space associated with the quantum cavity 
is a Fock space which we denote by % with inner-product (-\-) n and norm 
|| ■ lift. We drop the subscript, for ease of notation, if this causes no confusion. 
Let the set 3 

{\n):neZ+} 



2 See e.g. [14, Sec. 8.3] for more details of the quantum Harmonic oscillator model and 
notation used here. 

3 Z,Z + and Zq~ denote the set of integers, positive integers and non-negative integers, 
respectively. 
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denote the canonical basis of the Fock space H. Physically, the state \n) 
represents a cavity state with precisely n photons. 

Let a and a* be the annihilation and creation operators defined on do- 
mains T>(a) C H and T>(a)) C "H, respectively and N = a^a be the number 
operator with domain T>(N). These unbounded operators satisfy the rela- 
tions 

a \n) = \fn \n — 1) , a) \n) = y/n+ 1 \n + 1) , N \n) = n \n) (1) 
for all n G Zq . 

For all x G % and e > denote by B e {x) the open ball in % centered at 
x and of radius e. Also denote by B 1 = {x G H : ||x|| = 1} the closed set 
of unit vectors in "H with the topology inherited from "H. Let B' e (x) denote 
the set &i n B e (x) for all x G B\ and e > 0. Let C = (C(Bi), \\ ■ j^) be the 
Banach space of continuous functions on B\ with the supremum norm || ■ \ 00 . 

We denote by «^ = 8${B\) the Borel a- algebra of B\ and by M.\ the set 
of all probability measures on the measure space (B\,3§). For all \i G Mi 
and ^-measurable functions / defined on Bi we denote by 

E,[f] = [ f(x)dfi(x) 
JxeB! 

the expectation value of the function / with respect to measure \i. 
The support of a probability measure \i is defined to be the set 

supp(/i) = {x G B\ : fJ>(V) > for all open neighborhoods V of x}. 

2.2. Topology on Mi 

In this paper we study the weak-* convergence of probability measures. 
It can be shown (see e.g. [15]) that the space Mi is a subset of the unit ball 
in the (continuous linear) dual space C* of C through the relation ji G Mi i->- 
A M G C* where 

A„(/) = E M [/] 

for all / G C. When we refer to the convergence of a sequence of measures, 
we mean converges with respect to the weak-* topology of C*. 

Definition 2.1. We say that a sequence of probability measure {[i n }'^L 1 C 
Mi converges (weak-*) to a probability measure ji G Mi if for all f G C 

hm E^[/] = E M [/] 
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and we write 



In the weak-* topology on the set of probability measures, compactness is 
related to the notion of tightness of measures. A set of probability measures 
S C M.\ is said to be tight [16, p. 9] if for all e > there exists a compact 
set K e C B\ such that for all « G S, 



We recall below Prohorov's theorem (see e.g. [15]). 

Theorem 2.1 (Prohorov's theorem). Any tight sequence of probability mea- 
sures has a (weak-*) converging subsequence. 

2.3. Discrete-time Markov process 

We now describe the evolution of our quantum system which is governed 
by a Markov process on the state space B\. We introduce below the Markov 
process model with minimal references to the actual physical system under 
consideration. We refer the interested reader to [6, Ch. 5] and references 
therein for a description of the physical system and the approximations in- 
volved in deriving the Markov process model (also see [1, 2]). 

Define the displacement operator D a : H — > % and measurement opera- 
tors M s :7i—>7i where «Gl and s G {g, e} as 

D a = exp{ct(a f - a)}, M g = cos(6» + N(f>) and M e = sin(0 + N<f>). 

Here, 9 and are experimentally determined real numbers and the operators 
a, and iV are defined in Equation (1). Recall that because the operator 
i(a* — a) is self-adjoint, we may conclude from Stone's theorem that the set 
of operators {D a : a G M} form a strongly-continuous unitary group (see 



Denote by \ipk) G B\ the state of the system at time-step k. Given the 
state \ipk) at time-step k the state [V'fe+i) at time-step k + 1 is a random 
variable whose distribution is given by the following two-step equation 



^fc+1/2) = ji : , '] : r-j. with probability P s = \\M S \ip k ) ||^, (3) 



H[B X \ K e ] < e. 



e.g. [17, Sec V111.4]), i.e. 



lim || £> Q |V) - D ao |V) ||"H = 0, Wip G H. 



(2) 



|Vfe+l) = D ak |Vfc+l/2> • 

Here s G {e, g} and the control a k G M. 




(4) 
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Remark 2.1. The time evolution from the step k to k + 1, consists of two 
types of evolutions: a projective measurement by the operators M s and a 
control part involving operator D a . For the sake of simplicity, we will use 
the notation of Vfc+1/2) t° illustrate this intermediate step. 

The Markov jump probabilities may also be written in terms of density 
operators. Given any \ip) denote by the density operator \ip) Then 

I (^|n) | 2 = Tr { Pip \n) (n\} and \\M g || 2 = Tr {M 2 gPi> } . 

Here Tr {■} is the trace of a trace-class operator on %. If we set pk = \ipk) (i>k\ 
then we can write the Markov jump probabilities (3), (4) using the equivalent 
density operator description. 

Pfc+1/2 = r^^s^ with probability P s = Tr |M s (pfc)| 
H + / Tr{M s (p fe )} F J 1 KH n 

Pk = D Qfc (p fc ). 

Here, D a (-) = D a ■ D_ a and M s (-) = M s ■ M s are super-operators. We switch 
between the two equivalent descriptions throughout the paper depending on 
convenience. 

Remark 2.2. Equations (3) and (4) determine a stochastic flow in A4\ 
and we denote by Tk(po) the probability distribution of \ipk) , given po, the 
probability distribution of \ip ) . 

2.4- Some useful formulas 

We recall below some useful results. The Baker-Campbell-Hausdorff for- 
mula, which will be used to evaluate the derivatives of our Lyapunov function, 
states (see e.g. [18, p. 291]) 



00 



—rC n , (5) 



n=0 



where A, H and C n are linear operators on % and a G C. The C n are defined 
recursively with Co = A and C n+ \ = [H, C n ] for n > 0. 

Let X n be a Markov process on some state space X. Suppose that there 
is a non-negative function V on X satisfying E[V r (Xi)|Xo = x)] — V(x) < 0, 
then Doob's inequality states 

P f sup V(X n ) > 7 |X = x ) < (6) 

\n>0 J 7 
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3. Main Results 

We prove the main results of our paper in this Section. We wish to use 
the control a k to drive the system into a pre-specified target state \n) where 
n G Zf. 

We use a strict Lyapunov function V : B\ — > [0, oo] defined 4 

oo 

V(m = $>„ Mn)\ 2 + 6 (cos 4 (0 n ) + sin 4 ^) - \\M g |^)|| 4 - ||M e |^)|| 4 ) . 

n=0 

(7) 

Here 

n = 9 + n0 = cos" 1 (\\M g \n) ||) = sin" 1 (||M e |n) ||) , n = 0, 1, 2, . . . . 
5 > is a small positive number and 

I + ELi i - f> if - = ° 

a„=<( ifl<-<n 
(J, it n = n 

We set £>(V) C i?i to be the set of all \ip) G B\ where the above Lyapunov 
function is finite. 

Remark 3.1. We note that coherent states = exp(— |a| 2 /2) Y^=o 7TT \ n ) > 
for a G C are m ©(V). These coherent states naturally occur in optical 
cavities and are generally the initial condition is a coherent state in 
experiments. 

We choose a feedback that maximises the expectation value of the Lya- 
punov function in every time-step k - 



ag -Q.a 



a k = argmmV (D a \ip k+1/2 )) (9) 

c 

for some positive constant a. 



We choose this Lyapunov function assuming n > 2. The Lyapunov function may 
easily be modified for the case n = 0, 1 and all the proofs in this paper may be applied to 
that case as well. 
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Remark 3.2. The Lyapunov function and feedback are chosen to be this 
specific form to serve three purposes - 

1. We choose the sequence a n — > oo as n — >■ oo. This guarantees that if we 
choose oik to minimize the expectation value of the Lyapunov function 
then the trajectories of the Markov process are restricted to a compact 
set in B\ with probability arbitrarily close to 1. This implies that the 
co-limit set of the process is non-empty (see Lemma 3.11). 

2. The term —5(\\M g || 4 +||M 5 \ip) || 4 ) is chosen such that the Lyapunov 
function is a strict Lyapunov functions for the Fock states. This im- 
plies that the support of the oj -limit set only contains Fock states (see 
Lemma 3.12). 

3. The relative magnitudes of the coefficients a n have been chosen such 
that V(\n)) is a strict global minimum ofV. Moreover given any M > n 
we can choose 5, a such that for all M > m ^ n, and for all \ip) in 
some neighborhood of \m), V(D a (\ip)) does not have a local minimum 
at a = 0. This implies that if \ipk) is in this neighborhood of \m) then 
we can choose an a*. £ [—a, a] to decrease the Lyapunov function and 
move \ipk) away from \m) by some finite distance with probability that 
can be made arbitrarily close to 1 by an appropriate choice of a and S 
(see proof of Lemma 3.13). 

We make the following assumption 5 . 

Al The eigenvalues of M g and M e are non-degenerate. This is equivalent 
to the assumption that ir/<f) is not a rational number. This implies that 
the only eigenvectors of M g and M e are the Fock states {\n) : n £ Zq }■ 

The following Theorem is our main result. 

Theorem 3.1. Suppose assumption Al is true. For any initial measure \x, let 
Tk(fx) = r^' s (n) be the Markov flow induced by Equations (3), (4) and control 
otk given in Equation (9) with Lyapunov function V in Equation (7). Here, 
a determines the control signal and 5 determines the Lyapunov function. 

Given any e > and C > 0, there exist constants 5 > and a such 
that for all \i satisfying E M [V] < C, Tk(fi) converges (weak-*) to a limit set 
Q. Moreover for all jj,^ £ Q, \ip) £ supp(/ioo) only if \ip) is one of the Fock 
states \n) and 

Atoo({^}) > 1 - e. 



5 See Remark 3.3 below, to see how we may weaken this assumption. 
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3.1. Overview of Proof 

The proof of the Theorem uses several Lemmas that are proven in the 
next two subsections. We outline the central idea of the proof now. 

The Lyapunov function is such that choosing = ensures that the 
expectation value of the Lyapunov function is non-increasing. Therefore by 
choosing to be the a G [—a, a], that minimizes the expectation value of the 
Lyapunov function in each step, we ensure that Vifyk)) is a super-martingale 
(Lemma 3.10). 

The set {\ip) E B 1 : '^2 n a n \ (i/j\n) \ 2 < C} is a compact subset of B\ 
(Lemma 3.4). We use this fact and the super-martingale property of V(\ijjk)) 
to show that with probability approaching 1, \ijjk) is in a compact set for 
all k. This implies the tightness of the sequence T n (fi). Hence, we can use 
Prohorov's Theorem 2.1 to prove the existence of a converging subsequence 
(Lemma 3.11). 

Suppose r fc; (/x) is some subsequence that converges to a measure /x^. We 
show that the second term in the Lyapunov function V^d^)) = ^(cos 4 ^) + 
sm 4 (9 n ) — \\M g \ip) || 4 — ||M e || 4 ) is a strict Lyapunov function for Fock 
states. That is E^d^fe+i))! IV'*;)] — ^(l^it)) — with equality if and only if 
\ijjk) is a Fock state. This implies that the support set of all fioo only consists 
of Fock states (Lemma 3.12). 

Finally we note that the first part of the Lyapunov function Vi(\ip)) = 
^2 n o~ n \ (ip\n) \ 2 satisfies V Q Vi(|m)) = for all m. Moreover V 2 a V\(D a \m)) < 
for m 7^ n and V„Vi(Z) Q , |n)) > 0. This implies \m) ,m ^ n is a local 
maximum for the Lyapunov function. Therefore, we can find a feedback a to 
move the system away from Fock states \m) if m ^ n with high probability 
(Lemma 3.13). This therefore implies that we converge to our target Fock 
state with high probability. 

We prove in the following two sections the convergence result rigorously. 
We first establish some properties of the Lyapunov function. 

3.2. Properties of the Lyapunov function 

Lemma 3.2. For 5 small enough V(\ip)) is non-negative on B\. 
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Proof. We have, 

cos 4 (^)-||M,|V)l| 4 = (cos 2 (^)-||M 9 |^)l| 2 )(cos 2 (^) + ||M g ^)H 2 ) 

f oo \ 

cos 2 (0 s ) - ^cos 2 (0 n )| (ip\n) | 2 J cos 2 (<fe) 

n=0 / 
n=0 

Using a similar analysis for sin 4 ^^) — \\M e \ip) || 4 we get 

Here, 8 nfi is the Kronecker-delta. Because 

a n > min{ tTfl+i, a n _i} > 
for all n n, for 5 small enough, V > 0. □ 

For the remainder of this paper, we assume that 5 has been chosen small 
enough to ensure that V is non-negative. Also note that for 5 small enough 
V(\ip)) = if and only if l^) = |n). Therefore \n) is a strict global minimum 
for V. 

Lemma 3.3. The function V is lower semi- continuous on T>(V). 

Proof. Because M g and M e are bounded operators, \\M g \ip) || and \\M e \\ 
are continuous functions on T>(V). So we only need to prove the lower semi- 
continuity Of || \tf)) \\ a = J2n=0 a n\ (^\ n ) I 2 - 

Let |^o) = Y^=o c n \ n ) e T)(y)- Let e > be given. Then the finiteness 
of V(|^o)) implies that there exists an N such that 

oo 

e 



<?n\ (tl>\Tl) | 2 < 



2' 



n=N 

We can choose k small enough such that for all c' n satisfying \c' n — c n \ 2 < k, 

jv-i 



a \\c' I 2 - Ic l 2 l < - 



n=0 

10 



e 

7' 



Therefore, for all |^) e B K (\ip )) 

oo jV-1 



$> n |(^>| 2 > J2 a n\(^\n)\ 2 

n=0 
N-l 

> ^Z a n\ (V>o|n) | 2 - - 

n=0 
oo 



n=0 n=0 



n=0 

□ 

Lemma 3.4. For a// C > 0, the set V c = {\if>) G £\ : < C]} 

compact in B\ with respect to the topology inherited from %. 

Proof. Let l^) , \ip 2 ) , • • • be a sequence in Vc and let 

oo 
m=0 

Because, \\M g \ip) ||, \\M e \\ < 1 and o~ m is strictly increasing for m > n, 
we have 

^ , , 2 C-A 

) i \Cl, m '\ < 

m'=m 

for all I — 1, 2, . . . and m > n. Therefore, using a diagonalization argument 
we know that there exists a subsequence wi p ) and a set of numbers Coo im , 
m G Zq~ such that 



E: = Jc»y| 2 <^ ifm>n (10) 
|coo,m| 2 < 1 if m < n (11) 

Q,m ^ Coo,m- (12) 

We claim that |^ n ) — > 5^=0 c °°> m l m )- To see *his suppose e > is given. 
Then because a m — > oo as m — > oo, there exists an M such that 

(C-4)/a M <e/2. (13) 



11 



Also because q 
that for all p > P, 



as p — > oo, there exists a P large enough such 

(14) 



< 



— — for m = 1,2, 
2M ' ' 



M-l 



Combining Equations (10)- (14) we get for p > P 



m=0 



< €. 



The lower semi-continuity of V implies that the set Vc is closed. Therefore 



m=0 ^oo,m 



\m) E Vc- Hence Vc is compact. 



□ 



Let {s n } be any sequence of positive numbers with s n — > oo as n — > oo. 
Define an inner product 



= J^s n (x\n) H (n,y) H . 

n=0 

Here the (-\-) s is defined on the linear subspace H s of H on which || • || s = 
\J (-|-) s is finite. 

Given a linear operator A, let -Ra(^4) = (A/ — A)' 1 be its resolvent oper- 
ator. We recall below a Theorem in [19, Th. 12.31]. 

Theorem 3.5. A closed, densely defined operator A in some Hilbert space 
X is the generator of an analytic semigroup exp(aA) (w.r.t. the uniform 
topology of the set of bounded operators on X) if and only if there exists 
uj G K such that the half-plane Re{A} > u is contained in the resolvent set 
of A and, moreover, there is a constant C such that 

\\Rx{A)\\<C/\\-u\. 

We show that if we consider (a' — a) to be an operator on some domain 
in % s then exp(a(a^ — a)) is an analytic semigroup on % s . 

Lemma 3.6. The operator i{a — a') is symmetric on "H s . 
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Proof. Let , \<f>) G T>(a — at) C "H s and let \ip) = Y^=o c n \ n ) an d 



(a - a f ) |V>) = c ™( a ~~ at ) l n ) 

n=0 

oo 

= y^c ra (A/n |n - 1) - \Jn + 1 \n + 1)) 



n=0 

oo 



Cn+iV^ + 1 |n) - c^iv 7 ^ |n) 

n=0 n=l 



Therefore, 



— a 



^s p (z(a - a f )V>b) w (p\(f>) 



H 



Similarly, 



p=0 

oo / oo oo 

-i ^ s p I ^ Cn+iVri + 15 np - ^2 Cn-lVnSnp ) d p 

p=0 \n=0 n=l 

oo 

-i ^2 Sp(c p+1 dp - c p d p+1 )^/p+ 1 

p=0 



(VK(a-a f )0) s = i y s p (d p+1 c p - d p c p+1 ) y/p + l 

p=0 



Therefore the operator i(a — at) is symmetric. □ 

The operators at — a is well defined on the finite linear span of the Fock 
basis \n) and this finite linear span of the Fock basis is obviously dense in the 
space H s . The fact that at — a is closable follows from the fact that i{a — at) 
is symmetric (see e.g. [20, p. 270]). Therefore, we can assume that at — a is 
a closed operator (if it is not closed then we can always redefine at — a to be 
its closed linear extension). 

Lemma 3.7. The semigroup D a = exp(a(a^ — a)) is analytic in the set of 
bounded operators on % s with respect to the uniform operator topology of 
bounded operators on T-L s . 
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Proof. Because i(a — a') is symmetric, we have for all complex numbers A 
(see e.g. [20, p. 270]) 

||z(a — a f ) — AI|| > |Im{A}|. 

Therefore, 

llRxia ' ~ a)l1 - W(x}\- 

Therefore with u = and C — 1 and because (a* — a) is closed and densely 
defined, the conditions of Theorem 3.5 are satisfied. Hence the semigroup 
generated by (cr — a) is analytic. □ 

Lemma 3.8. Let m ^ n and C > V(\m)) be given. Then there exists a 
constant e = e(|m)) > such that for all e G (0,e) and \ip) G B' e {\m)) 
satisfying V{\ip)) < C , 

V(D a m - V(\i/>)) = + / 2 (|^»« 2 + 0(a 3 ) + 0(5) (15) 

for \a\ < a — a(C). Moreover, / 2 (|^)) < 7 m < for some constant j m . 

Proof. Because M e and M g are bounded operators on "H and D a is an analytic 
semigroup on H, we have 

v(D a m - vm = \\D a iv> \\i - ii w us + 

where || • || CT = Y^=o a n\ (-|n) | 2 . 

We know from Lemma 3.7 that _D a is analytic with respect to the uniform- 
operator topology induced by the semi-norm 6 || ■ \\ a . Hence, for all \vp) such 
that || \ip) \\cr < V{ip) < C we can write, using the Taylor series expansion at 
a = 0, 

ii a, m ii' - ii m \\i = fiimh + / 2 (i^)« 2 + o(a 3 ) 

for | a | < a and a only depends on C . 



6 Evcn though the Lemma 3.7 was proven for sequences s n > 0, we can apply it to the 
case where one of the s n is zero. In fact small changes in s n do not change the analycity of 
D a . We can prove the same Lemma by considering the quotient spaces of the semi- norm 
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We now prove the required bound on f 2 using the Baker-Campbell-Hausdorff 
formula (5). By noting that 

oo 

\\ D a IV) \\l = J^nTr {exp(a(a f - a)) \if>) (tp\ exp(-a(a f - a)) \n) (n\) 

n=0 

and setting H = a) — a and A = |V) (V| in Equation (5), we get 

/ 2 (IV)) 

^ oo 

= 2 ^ CrnTr ^ ^ ~ a ' ^ ~ a ' ^ ^ ^ 

n=0 

= - °nTr { (T 2 |V) (VI + IV) (VI T 2 - 2T |V) (VI T) |n) (n|} . (16) 

n=0 

Where we have set T = a' — a. If we let |V) = Yin c n l n )' then 
^Tr{(T 2 |V) (VI + m (VI T 2 ) |n) (n|} 

= ^(n|T 2 |V)(Vl^) + (V|T 2 |n)(n,V) 

= Re{ y/{n + l)(n + 2)c n+2 < + y/n{n - l)c n _ 2 <} 

-(2n + l)|c n | 2 (17) 

and 

Tr{T|V) (VI r|n) (n|} 
= (n|T|V) • (fp\T\n) 

= ^n(n + l)Re{c n _ic* +1 } - n|c n _i| 2 - (n + l)|c n+ i| 2 . (18) 

Substituting Equations (17) and (18) into (16) and rearranging terms, we 
get 

oo 

h{W)) = ^ \c n \ 2 ((n + l)<7 n+1 + na n _i - (2w + l)cr n ) 

n=0 

oo 

^Re{c n _ic* +1 } v / M^-^)( (T n-i + ^n+i - 2cr n ) (19) 



n=0 
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If 2 < n ^ n then substituting for a n from Equation (8) we get 

-1 



(n + l)cr n+ i + ncr n _i - (2n + l)a r , 



n(n + 1) 



and for n = 0, 1 we get 



(n + l)a n+ i + na n -i - (2n + l)a n = — 
Substituting this into (19), we have for 2 < m ^ n, 

12 



■MM) < 



^ 7 , 



+ \cn\ ((n + l)crn+i + na n -i] 



III 

oo 



+ ^Re{c„_iC* +1 } v / M^+^)( cr ri-i + a n+i - 2cr n ) (20) 



n=0 



where 



m(m + 1) if 2 < m ^ n, 
4 ifm=l,2 



For all G Sg(|m)), the first term in Equation (20) will be less than 
-3/(4« m ) for e small enough. We show that for e small enough, for all 
jj) G B' e {\m)) such that V(\ip)) < C, 



> \Cn\ 2 {{n + l)a n +l + TUT n -l) 

oo 

J^Re{c re _ic* +1 }A/ri(ri + l)(a n _i + a n+i - 2a n ) 



+ 



n=0 



(21) 



For all G i?^(|m)) we have |c s | 2 < e 2 and hence we can choose a small 
enough e such that 



c n \ ((n + 1)«7b+i + fi«7 fi _i) < 



1 



5K r 



(22) 



We have 



|-y/n(n+ l)(cr n _i + cr n+ i - 2cr re )| = ^(n + 1) 



h(n) 



n 2 + 3n + 1 
n 2 (n + l) 2 
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The function h(n) defined in the above Equation is of order 0(l/n). Because 
a(n) is order 0(ln(n)) and because the series J2 n \c n \ 2 a n < C converges, we 
know that the series ^2 n \c n \ 2 h(n) converges. Hence, Y1™=m \ c n\ 2 h{n) can 
be made arbitrarily small for large M. By Cauchy-Schwartz, X^ n l Cn l 2 — 
Re{c n __ic n+ i} and hence M can be chosen large enough such that for all 
l^} satisfying V(\^)) < C, we have 



^ Re{c n _iC* +1 }-\/n(n + l)(a„_i + a n+1 - 2a Ti 



n=M 



< 



(23) 



Because \c n \ 2 > Re{c n _ic* +1 }, we can choose e small enough so that 
for all |^) G B e (\m)), 



M-l 



-lC 



n+1 



2a r . 



n=0 



< 



1 



4« r 



(24) 



Equations (22), (23) and (24) prove Equation (21). Substituting (21) into (20) 
we get the required bound, 



/ 2 (hA» < lm < o 

where 7 m = -l/(An m ). 

We have the following Corollary to the above Lemma. 



□ 



Corollary 3.9. Given any m ^ n and C > V(\m)), the constants a and S 
in Equations (9) and (7), respectively, can be chosen to be small enough such 
that there exists an e > and c > such that if 



then 



|^> G W £ 4 B' e {\m)) n {|^) : C > V{\^)) > V{\m)) - e} 



V(\i/jk+i)) — VQ^k)) < ~ c , with probability 1. 



Proof. Let e be as in Lemma 3.8 and choose e' G (0, e). Because M 5 and M e 
are bounded operators on "H and M 9 |m) = \m) and M e |m) = \m), e can be 
chosen small enough such that if \^k) G B' e (\m)) then ^+1/2) G -B^(|m)). 
Moreover, we can show using the same argument used to prove Lemma 3.10 
below, we know that if V(\tpk)) < C then V(|^>fc+i/2)) < C. Therefore, if 
l^fc) G W e then ^+1/2) G W e ' with probability 1. 
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Now we choose a small enough such that the term of order 0(a 3 ) in 
Equation (15) is smaller than :tn! ^—- Then from Lemma 3.8 we know that for 
all lib) G W e ' and for either a = +a or a = —a, we have 



V(D a ty))-V(\1>))< 



We can choose 5 small enough such that the 0(5) term in Lemma 3.8 is 
Therefore, for all \ipk) £ VV e the statement of the Corollary 



7m a 



smaller than 

is satisfied by choosing c 

3. 3. Proof of Convergence 

We wish to establish that V(\ipk)) is super- martingale. We have, 

E[y(l^fc+i»|l^> = l^>] - W» 

= e[v {D ak (i^ + i /2 ») i m = m] - v(m 



□ 



E 



argminV" (D a (|^fe+i/ 2 ))) 

a£\—a,a] 



(25) 



where we set 



km) 



E 



argmin V (D a (l^fc+1/2))) | Hk) 



a€ — a,a\ 



-E[V(\D (ip k+1/2 ))\\Tp k ) = \iP)], (26) 

K 2 (m 4 E[y(D (|Vfc+i/2>))||V'*) = lV')]-mV'» 

= E [V (|^+i/2» I = IV-)] - (27) 

Obviously ifid^)) is non-positive for all In order to calculate i^dV')) 
we set p = p?/> = (^1 an d we note that M g and M e commute and satisfy 
Mg + M| = I, where I is the identity operator. Therefore, 

2 



\M P . 



Tr{M 2 e p}' 
(Tr{(I-M») 2 
(l-Tr{M>}) 2 
l-2Tr{M|p}+Tr{M>} S 



2\\M„ 



\M n 
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But, 



E[||M g |^ + i/ 2 )|| 2 ||^>=^] 

M n m 



Tr{M>} + Tr{M|M e 2 p} 



\\M e \^)\\- 



M n 



Mr 



\\M e |V) II 



= Tr{M» 
= l|M 9 |^)|| 2 . 
Similarly, we get for all |n), 

E[| {n^ k+l/2 )\ 2 \^ k =\4>)] = \(n,4> k )\ 2 

Therefore, 

K 2 {\^)) = 2 (\\M g |V) || 4 - E [\\M g |V fc+ i/ 2 > || 4 | m = IV)]) 

We have, 

E[||A/r 9 |v fc+ i/ 2 >|| 4 |IV fc ) = 



Tr {M>} Tr {m 2 ^^) 2 + Tr {M 2 p} Tr ( M 2 -^^ 
1 gfS | 9 Tr{M2p}J 1 J I 9 Tr{M e 2 p}J 

Tr{M>} 2 Tr {M g 2 M e 2 p} 2 
Tr {M 2 p} Tr{MM 

Tr {Af>} 2 - Tr {M g 2 p} Tr {M>} 2 + Tr {M 2 p} (Tr {Af g 2 p} - Tr {M^p})' 

Tr{M 2 p} Tr {M 2 p} 

Tr { Af>} 2 + Tr {M 2 p} 3 - 2Tr {M 2 p} 2 Tr {M g 4 p} 



Tr {M 2 p}Tr{M 2 p} 



Therefore, 



KM)) 



2 \\M n 



E[||M 9 |V fc+ i)H 4 |lV fc ) = lV)]) 



2 f T r (M 2 .) 2 - Tr i M » 2 + Tr i M » 3 ~ 2Tr i M M 2 Tr KM \ 
\ 1 9 ] Tr{M 2 p}Tr{MM J 

-2 (Tr{M>}-Tr{M>} 2 ) 2 

- (28) 



Tr{M 2 p}Tr{M 2 p} 
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The following Lemma is a consequence of the above calculation. 
Lemma 3.10. V(\ipk)) is a super-martingale and satisfies 



Tr{M>}-(Tr{M») 

E[V(|^ +1 ))||^) = |^)]-ni^))<-2 V 



2 x2 



Tr{Af>}Tr{MM 



Here p 



Proof. Firstly from the lower semi- continuity of V (Lemma 3.3) we know 
that V is measurable function of Therefore E M [V] is well defined. The 
super-martingale property follows from Equations (25), (28) and the fact 
that Ki(\tf))) is not positive because G [—a, a]. □ 

Lemma 3.11. J/E^fK] < oo then the sequence T n (/i) has a (weak-*) con- 
verging subsequence. 

Proof. We prove that the sequence of measures r n (/i) is tight. 

Let e > be given. We need to show that there exits a compact set K £ 
such that [T n (fj)](K e ) > 1 — e for all n. By Lemma 3.4, the set 



V=\\1>)eB:V{\iJ>))< 



is compact. We prove that [r n (/x)](V) > 1 — e. 
Because V(\ipk)) is a super-martingale, we have 

E rnW [V]<M,[V\. 

Hence, by applying Doob's inequality, the probability that V{\ip n )) > E M [V]/e 
is 

[TMKB^V) < e. 

Hence, the sequence T n (/j,) is tight and by Prohorov's Theorem 2.1 has a 
(weak-*) converging subsequence. □ 

Let Q denote the limit set of T n (n). i.e. 

= {/ioo G Mi : r nm (/i) ^ (i, for some subsequence T nm of T n }. (29) 

Lemma 3.12. Suppose assumption Al is true. If\ip) is not a Fock state \n) 
for some n G Zq" then \ip) supp(/ioo) for all ^ G fl. 
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Proof. Suppose r^[/i] p^. We know from Equation (25) and Lemma 3.10 
that Ki(\ipk)) + K 2 (\ipk)) — > as k — > oo. Because both K\ and K 2 are 
non-positive, we need K 2 (\^k)) — ?• as A; — >■ oo. Therefore, for all initial 
distributions p 

limEr kpM [K 2 ) = 0. 

Also note that the function K 2 in Equation (28) is a continuous function 
of \ip) G Bi with respect to the topology inherited from %. Therefore, by 
the definition of (weak-*) convergence of measures 2.1, we have 

E M J# 2 ]= limE rfep(M) [K 2 ] = 0. (30) 

But from Equation (28), we know that if K 2 (\ip)) = then 

Tr{Af>}=Tr{M>} 2 . 

But the Cauchy-Schwartz inequality implies Tr {M^p} = Tr { M^p} Tr {p} > 

Tr { Af|p} 2 with equality if and only if Mg p and p are co-linear. That is if and 
only if p is a projection over the eigenstate of M*. Therefore, by assumption 
Al, K 2 (\ip)) < with equality if and only if \ip) is a Fock state. 

Now if |^) is not a Fock state then there is an open neighborhood W of 
such that the neighborhood does not contain a Fock state. Therefore, 
Voo(W) = otherwise E Moo [if] < contradicting (30). Therefore £ 
supppoo. □ 

Lemma 3.13. Given the assumptions of Theorem 3.1, for any Fock state 
\m), m 7^ n and for all k, C > 0, there exist constants a and 5 > and 
a neighborhood V of \m) such that if E^[V] < C then Poo[V] < k for all 

Poo G 

Proof. Suppose T Pq (/j,) is some subsequence of r p (p) that converges to poo G 

a 

Given any v > 0, the lower semi-continuity of V implies that the set 

V u 4 B' u (\m)) H m G B x : > V(|m» - u} 

is an open neighborhood of \m) in 5i. Because V v is open, we know from 
the (weak-*) convergence of r p (p) — >■ p^ that 

liminf[r P9 (p)](V,) >Poo(V,). 
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Therefore, in order to prove the Lemma, we need to show that for some 
v > 0, 

lim T Pq (V u ) < k. 



Because E^V] < C we know from Doob's inequality 6 that for all p and all 
v > 0, 



[r»] 



eV u cB 1 -. V(|V» > 



c 

«72 



< 



We show that there exists a v > such that lim 



EV„CB 1 : V(\ip)) < 



p— >oo 

c 



k/2 



(31) 
0, where 
(32) 



We know from Corollary 3.9 that there exists an e > and c > such 
that if 

c 



' k/2 



> V{\^)) > V{\m)) 



then 



V(\ijjp + i)) — V(\if} p )) < — c, with probability 1. 

Therefore if \ip p ) G W e , then for some finite P satisfying p < P < 
we have 



c 

k/2 



e /c 



\ip P ) G {|-0) : V(|^» < V(|m)) - e} with probability 1. 

We choose u = e/2. Then if |^ p ) G V y then within a finite number of steps less 

than ej /c the system state is in the set {|^>) : V(\^)) < V(\m))—e}. 

But because {\ip) : V(\ip)) < V(\m)) — e} R V v is empty, we know that if 
\4>p) G V u then the process is outside V u within a finite number of steps less 

than 



So limp_ K30 [r p (/z)](V I ,) 7^ if and only if the Markov process jumps back 
and forth between the sets {|^>) : V{\tp)) < V(|m)) — e} and V v infinitely 
often. But the supermartigale property of V{\ip p )) and Doob's inequality 6 
implies 



prob 



V{\%)) < V{\m)) - e and inf V(\tf p )) > V(\m)) - - 

p'>P z 



< 1 



V(\m)) 



V(\m))-e/2 



< 1. 



22 



As the probability of a single jump is less than 1, the probability of in- 
finitely many jumps is zero. Therefore lim p ^ 00 [r p (/i)](V I/ ) = and from 
Equations (31) and (32) we get 

/^(K) < liminf[r p >)](K) < k. 

q— >-oo 

□ 

We now finally prove Theorem 3.1. 

Proof of Theorem 3.1. Let e > and C > be given. 

We know from Lemma 3.12 that the support set of only consists of 
the Fock states \m). Because a n —> oo, there exists an M such that o~m > 
C/(e/2) + 5. Because for all m > M, V(\m)) > o~ m — 5, the supermartingale 
property of Vd^fc)) and Doob's inequality (6) implies for all k e Zq , 

TM({\m):m>M}) < t 

If we set k = e/2M in Lemma 3.13, then we know there exist constants 
a > and 5 > and neighborhoods V(\m)) of \m) for < m < M,m ^ n, 
such that 

Voo({\m)}) < — . 

Therefore, (/.ooQn)) = 1 — ^oo({\ m ) '■ m 7^ n}) > 1 — e. □ 

Remark 3.3. In Lemma 3.12 we show that the only vectors in the support of 
/ioo are those corresponding to eigenvector of M s . We then used assumption 
Al in the proof of the Lemma to claim that the only eigenvectors of M s are 
the Fock states. We can however weaken this assumption to the following: 
for some large M such that om > 2C/e, eigenvalues corresponding to eigen- 
vectors \m) , m < M are non-degenerate. This is because, we can show that 
if some eigenvector \ip) is in the span of the set {\M) , \M + 1) , . . .} then 
using the same argument as that used for \m) ,m > M, we can show that the 
probability of \ip) is small. This is significant for cases where M g is a more 
complicated non-linear function of N , as is the case in a practical system. 

Remark 3.4. In this paper we prove (weak-* ) convergence ofTk(ti) to some 
/ioo. The quantum expectation value of an observable (self-adjoint linear oper- 
ators) T : H H is some state \ip) , defined (T)^ = (ip\Tij)) is a continuous 
function of \ip) ifT is bounded. Therefore, if we think of (T) : i— > (T)^ 
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as a random variable on the state space B\, then by the (weak-* ) convergence 
ofT kl (fi) to fioo, we have 

lim Er fc>) [<T)]=E M J<T)]. 

In particular ifT= \n) (n\ then 

lim E T M [(\n) (n\)} = E M J(|n) (n|)] > 1 - e, 

I— >oo 1 

where e is as in Theorem 3.1. But (\n) (n\) is precisely the (quantum) prob- 
ability that the system is in state \n). Therefore, the probability that the 
quantum system is in the state \n) maybe made arbitrarily close to 1. 

Similar statements maybe made about the standard deviation of bounded 
observables T : T-L — > %. 

Simulations have been performed with the controller in Theorem 3.1 by 
truncating the controller using a Galerkin approximation. The simulations 
indicate that the controller designed using the infinite dimensional Hilbert 
space provides performance improvements (of about 4-5%) in the probability 
of convergence to the target state when compared to the controller designed 
using the finite dimensional approximation [8]. Moreover as shown in The- 
orem 3.1 the feedback parameters a and 5 maybe chosen to increase the 
probability of convergence to the target state. 

4. Conclusion 

In this paper we examine the semi-global, approximate stabilization of the 
Markov process in Equations (3) and (4) at a photon-number target state. 
The Markov process is defined on the set of all unit vectors in the infinite 
dimensional Hilbert space %. The non-compactness of this set of unit vectors 
dictates the use of a special Lyapunov function (7) to show the following in 
Theorem 3.1 - provided the initial measures /i satisfies certain initial condi- 
tions, for all e > we can choose feedback such that with probability greater 
than 1 — e, the Markov process converges to the target Fock state. 

5. Acknowledgments 

The authors thank M. Brune, I. Dotsenko, S. Haroche and J.M. Raimond 
for enlightening discussions and advices. 



24 



References 

[1] M. Mirrahimi, I. Dotsenko, P. Rouchon, in: 48th IEEE Conference on 
Decision and Control, IEEE, Shanghai, 2010, pp. 1451 - 1456. 

[2] I. Dotsenko, M. Mirrahimi, M. Brune, S. Haroche, J.-M. Raimond, 
P. Rouchon, Physical Review A 80 (2009) 013805-013813. 

[3] S. Deleglise, I. Dotsenko, C. Sayrin, J. Bernu, M. Brune, J.-M. Raimond, 
S. Haroche, Nature 455 (2008) 510-514. 

[4] S. Gleyzes, S. Kuhr, C. Guerlin, J. Bernu, S. Deleglise, U. B. Hoff, 
M. Brune, J.-M. Raimond, S. Haroche, Nature 446 (2007) 297-300. 

[5] C. Guerlin, S. D. J. Bernu, C. Sayrin, S. Gleyzes, S. Kuhr, M. Brune, 
J.-M. Raimond, S. Haroche, Nature 448 (2007) 889-893. 

[6] S. Haroche, J. Raimond, Exploring the Quantum: Atoms, Cavities and 
Photons, Oxford University Press, 2006. 

[7] M. Brune, S. Haroche, J.-M. Raimond, L. Davidovich, N. Zagury, Phys- 
ical Review A 45 (1992) 5193-5214. 

[8] R. Somaraju, M. Mirrahimi, P. Rouchon, arXiv:1103.1724vl (2011). 

[9] K. Beauchard, M. Mirrahimi, SIAM J. Contr. Optim. 48 (2009) 1179- 
1205. 

[10] M. Mirrahimi, Ann. IHP Nonlinear Analysis 2 (2009) 1743-1765. 

[11] K. Beauchard, V. Nersesyan, ArXiv e-prints (2010). 

[12] J.-M. Coron, B. dAndrea Novel, IEEE Trans. Automat. Control 43 
(1998) 608-618. 

[13] J.-M. Coron, B. dAndrea Novel, G. Bastin, IEEE Transactions on Au- 
tomatic Control 52 (2007) 2-11. 

[14] G. Teschl, Mathematical Methods in Quantum Mechanics: With Ap- 
plications to Schrodinger Operators, volume 99 of Graduate Studies in 
Mathematics, American Mathematical Society, 2009. 

[15] M. Merkle, Zb. radova Mat. Inst. 9 (2000) 235-274. 



25 



[16] P. Billingsley, Convergence of Probability Measures, John Wiley & Sons, 
Inc., 1999. 

[17] M. Reed, B. Simon, Methods of modern mathematical physics, volume 
1. Functional Analysis, Academic Press, 1980. 

[18] M. A. Nielsen, I. L. Chuang, Quantum Computation and Quantum In- 
formation, Cambridge University Press, 2000. 

[19] M. Renardy, R. C. Rogers, An Introduction to Partial Differential Equa- 
tions, Springer- Verlag, 2 edition, 2004. 

[20] Kato, Perturbation theory for linear operators, Springer, 1966. 



26 



